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t, 10 

Mtmmmim^&X'tmz ftfc mmmmzmf&t %> 

mi&timiii^ g-eSHi £ ftfc titiMtfm'h t & m 

mtftt % 2 -Dtommfr h tat] $ n^«?r- * <o^m 

mmwmmfr ztatiz n% r- * £hui b^mis 
mmzT'W&zftrcmm^mimcffimtzkmmmT- 20 

mmfr h tts^j £ n 3 x- * £MiBaa-f § H^Ma 

ituIS^PfiMcjfflg LTBBB2 ftMIB^PfiiSfg £ Ir)— 

mm&mmfaMimT'fe&zntzmiffimmoy ? % 30 

Huie^»£ti£t?cfc 9 &{lxfill8^(cBEB$ftTl^ 

t, 

2^<Dmmfrh\btiiEft%mi-T-z<D\&t>i£i£wm 
HutBta tsmwmn mr-nta $ ft m^mtm^ t & 5 «? 

ME1«£raRfittlilff STtttH £ ftfc HuSe^HM* 

mffeT*gm $ ftfeMi stem kike* 5 ^iwsit- 

HtfcfctfJU fflllB8O0ifi«jli**>6 4O0lii3Rffl«rff 
H*#«»EfiSftT^*aH*^Kfc» i!fjBE*^-r-£ 50 



ftffl 2 0 0 1 - 3 0 7 0 7 9 
2 

*MiE&ai-&&aiass££«*5is#j&agBK> m 

I ESMS^SCS- $ ftT ^ 5 ^PiHSIfr <E> HJ*J $ ft 3*P 
x-*£*SIEt5fc&^Ma£^fT£tfS7n^A# 

t b® * ft rc 3 > tr =l - z m&w. k> o 

T, 

HUlE*fiSBijRfc£& LTBEB£ ftBuIE^ffiH^ R-fe 
HylEJfiSii^tB¥IiT^tH^ft/cHfifEifi^iS^©3^ 

ffllEiB*fflft^¥liiT-^^?ft/cHuIBII«ffl^ffi^i» 

MiE(±S7jM^«/j^t^?>#^ii*ffl^atti-r§#Siffl« 
tuiE^iaiiiSfi^^-rs 2-Dommt^nnifEti^m 

m^m^ntii $ ft itm i^mmc mm* tff- ^ s 

3 > tf a - ^ 0 "I^^IBg^fto 

[ft** 5] HufBBfillSft$¥JHT*Mu 8o<D3fiSlii 

[000 1] 
[0 0 0 2] 

[ft*<Dt$ffi] CCD (Charge Couplled Device) &if 

A^^fcfiJfflSft^CCDti, -flSfC 3 075^5.200 
7J©H^WLT^-5o ifi^T-(±T , ^^^*p<5 
<Dmmt5&tfMim<Dfa-tZm2>tcib^ 3 0 07?a^ 

[0003] 

[f8W*<»»LJ:$fc-f5Wffl L3^tft*<6, CCD 
ftifOHfraiMWR^Ktt, IESta:iB««IH*iii*Blt)S 



(3) 

3 

[0004] sua, mm<DmmicimLTtht><D±% 

[ooo5] ^©fcto, kmmmfrz&jjZftzmirT 
#© «fe a k 1 5 p&Xfr p> a* £ n s r- 9 

[0006] =tcx\ *m\v>mms.. mkm^wm 

d ii \C $) o 

[0 00 7] 20 

mm*w&t&tctb<D¥m *%m<m&& 1 ise© 
®#®a^Ss it*3S 2 iB«©ffii^saa^ffi $ & mux 

^tttb-r-^o amjsnfcBS3Rfi*«ifi8"r*2o©iii3R3^ 
5>w#£n5m^T-#©¥tiifL*stHu ^<DTO* 30 

[0008] iBjgia*«i^"rs2ooisjfe^6Hi^*n 

fcf«:<fc»K fcKH*©HH?*?r-*©Hi7J©gfl:fi 
®jRffl«:S!Jj!c-rs 2o©iB3Ri:^IS(iiii3Ri:0»fi* 

fc{ifisg©atffctf«'h?&3a&#*«a-rs c fctft-t 

*Sft8«?f-^ iriiififclt 5 fc#4Tc 4#T*t 

"So 

[0 0 0 9] ^LT, C©iffllilffl£$$1-?>2 0©iliig 

[0 0 10] *?PJl©lf**3fe*©ii§!^«73&3: fc 
ttW^5E«©iE8»#fc<fc3iU a-3<0j&&M%fr 50 
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©fctbstifcHilsa^ 4o©HjRii^fiFifi*ns. ufc 

flaWS <, *SiE&g©»i^fi±£#5c4;iWe#3 0 
[00 1 1] 

-So 

[oo 1 2] H2fc^-r c i;^(cf : v^^^7 1 fi, m 
m»i o, mmxti^mz o, ie§ia$3 o, gjsau o 

3hj» i o(iia^A73^S2 o^e.m7j?n/c«?x- 

9%mW?Zrctb<DW.%®3&X3bZ 0 $m&i on. c 
PU (Central Processing Unit) IK ROM (Read 
Only Memory) 1 2 33«fc OBSESS 6 0£WLT^5 o 
ROM 1 2£{J, MASl 0©C PU 1 1 fejct/Mam 

[0 0 13] 03tc^-r<t9ftSQS@SS6 (Hi, i£SH 

6 3, wimmwMuti^m 4, ¥*5f6*a*is6 5*5 

Bl 2 «k -5 (chinas l OKfcL a— »f*»6© 
A73£3tttt»t3;fc»©A*¥S*^;£ttTV3„ A 
tl^mtLXlt, a-lf^6»»©^fT©J§^A*S 

n5->+y^— ##>7 k ^e.mc'T^^^*^'? 1 
©«^©«s6©tiffft , A**ti«aas©A*#i'y7 2 

[0 0 14] jH«A2j#82 (Hi, *ftb>X2 K S 
«?gfcLT©CCD2 2, AMP*5«fct>*CDS^tJ 

So jfc31£U>X2 1 S ©Jt% C C D 2 2^31 

^t^o CCD 2 2im&<DWm*&LT^Z> 0 CCD 

[0015] jffl^ti, fwi(cfnfn*7-7^^ 

^A«I?tlt^5o Sfe©^2^7^;l^©«^ c 
y (Cyan) s Mg (Magenta) fYe (Yellow) *3«fcQ* 
G (Green) CCD2 2©ffife7 

fc, *^i5t60iJ©J;atcMfe©*7-7'f';l/^%W-rsc 
CDCl^ R, B*^ft%IS€l©*'7-7-f;l/ 

^^w-rsccD^svHi^y^DccD, sfcacc 

DW©JH»*?K:feiifflRlfil1?fe*o ftfe, *^5g^J 
■etiH 4 fc^-T <k b %W&7'(fr#%fit 5 C C D 2 2 



5 

[0016] c c d 2 2 (D&mmm?^xM ztircmt 

«M§*f £g&SftTfcb*j£ft5o C C D 2 2 frZmtl 

g§2 3Tf->"?/K?)tfT-^'\|||jn5 0 
[0 0 17] !E^9$3 0{±, RAM (Random Access Me 
mory) 3 1 tei-XSy^vi/ 3.*^) 3 2£WLT^3 0 

5 l£»lttiftMSl9tttt&ft , TV3o RAM 3 Hi, 
ftiJiJg|5l 0T*fflaSfc(iA/D^§§2 3A^m*$n 

a^€'J3 2ii, R AM3 1 fc— B$$|£I38SftTV5 

[0 0 18] ^954 Oti, 1^81 (LCD) 4 
IfeitfVRAM (Video RAM) 4 2*£l/C^*. L 
CD 4 Hi 7 a ;*€•>) 3 2 KEgSttT^S*? 
r * $ fc tt A / D $81$ 2 3 6 W * $ n fc x 5? 2 ;1/ 
(DM 1 ? r — £ tcSo* < iHt^a^T §c VRAM42IC 
(4 L C D 4 1 ?a*-r«fc*K«? 
S^T-^tflB^ftTl/^So -fy^— 7x^7.5 0 
tt, 3 2fciE®£ftTi/^*?-r-£ 

fcflSOMA tf > <- V r /1/3 > tr a - * & 2 m 

7:-r5o 

[0 0 19] &fc % HflW|ia©^ffiCOV^T»aifCSiM 
t5 0 ccTti. —Mi: LTH l Ictt^Xo icWMtFBZ 
B£n7cCCD2 2K*l>T, C y 2 2 ^RSH*?* 
3*I^cov>T!&Bjrf 3 0 HlfcfettSCy OOfcif© 

BStS^li, rc yj tf^ojBSRtfSft-rsftofefctt 
#fS7w/i/*<D6*^u rooj *^©ffl*offi« 

[0 0 2 0] MfltfJj¥82 0©CCD2 2fr£Utfj£ 
ftfctffx-***, -BfEiSgP3 0CRAM31 fcfBtt 
$tl§o t?f-^!i, CCD 2 2©£iffijg©7Kl'X 
t*fJtSLTRAM3 1 <03f3£0®«K:|S1t«nSo 

[o o 2 1 ] 0 1 fcTK-rj: oicKMmmft&zm^ 

SiaiH^tB^6 1 ii, ^PSBSIC y 2 2KiS«LTE 

g$n, kmmmc y 2 2 i:iii-©feo^*s3t-rs 8 

JRj ti^ a ) %HtHfSo 0 l EaVf «fc 3 ftHJROE 
fi©*£, ififtHJftiCyOO, Cy0 2, Cy0 4, 
Cy20, Cy 24, Cy 40, C y 4 2 *5<fctfC y 4 
4©8O-c"'fe5 0 %.V&mmc y 2 2fi, flRtfUittHSr 

fev^maj^n, &ft$tifc^iwm7^>'a^ 
u 3 2icz<D{mmmtfmmzftz>o Lfttfot, sag 

H*lftUi^a6 l (i77'^a^t'J 3 2£ESSttT 
^S^RgH^Cy 2 2 ©fifititfSfcS^T, 0 1 ©tf 

C y 0 2, Cy 0 4, C y 2 0, Cy24, Cy40, 
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C y 4 243<fctfC y 4 4%1$aj-f £<= 
[0 0 2 2] HX&ffr£¥36 2& tfttHLfcifiSHiii* 
^eii^ffi^^-rSe fcfi&iliSlSC y 2 2£ 

.{*<*«?<}: 5 attBBB^tEKSnTV^ 2 ocD3fitgji^ 
Ko^tMJti^o -rfcta'S* H5g|i&0 l Qttflrc 

T, 40©liStffldl (Cy 0 0i:Cy 4 4) , d2 
(C y 0 2 £C y 4 2) , d3 (Cy04iCy40) 
10 $3«ktfd4 (Cy 2 0i:Cy 24) jWfiJc£*l3„ 

[0 0 2 3] &±)%W\ii^®6 3t±, ffASnfcHJBIB 
dl, d2, d 3fc<fctf d 4 fcOl^T^ft^tlUtfjiga 
^Wtti-TSo tfi^M-Hi, Di£ffld U d2, d3*5cfc 
tfd 4tt ; tft : eftmi&t%2-0(Dmm (CyOOhCy 
44), (Cy02iCy42) , (Cy04iCy4 
0) 45«fctf (Cy20iCy24) Jb^ttiTjcTtlR AM 

20 *mtff-^^8bi t©^, 0A^2 5 5I 
T-0 2 5 6BMi:l^Cli:fCJ8:S 0 
[0 0 2 4]M*fcf> jfiJfffiiRC y 0 0, Cy02, C 
y04, Cy20, Cy24, Cy40, Cy4 2fci 
tfCy 4 4fr&W#;£tt5treT f -*#ei5KaVfr«fc'5 

[0 0 2 5] LTF<DRTHZ, H^ffld 1^«^-TS2 0 

<Dmm (cyooi:cy44) ^eHi^sns*^ r- 

30 *cDttJ7JM£ <5 1 > B^ffid 2 *««-rs 2 Oc7)Bi« 
(Cy02i:Cy42) J&^tfl^SnS^r-^OHl 
7JM^<5 2, iii^ffld 3^«^1-§20©li^ (Cy 0 
4i:Cy4 0) ^em73^tl§«^x-^cDtiS7jM^<5 
3, fcBtffcBi&ed 4**jg"r5 2 0©H* (Cy2 
0hCy24) ^6tB7J$nS*?x-^©ai73M^(5 

[0 0 2 6] H5fc:jjVf*£\ ^»®|RCy 2 2*^a 
73^n5ffi?r-^{iHH<DJfiSH^Cy 0 0, CyO 
2, Cy04, Cy20, Cy24, Cy40, Cy4 
40 2&XXSC y 4 4 frBm^SftStff-r-** ») fc/Jvf 

[0 027] 5l=|Cy0O-Cy44 | = | 190 
-2 3 0 1=4 0 

c52=|Cy02-Cy42 | = | 240-210 ] = 
3 0 

53=1 Cy04-Cy40 |=| 250-1 50 |= 
1 0 0 

<54=|Cy20-Cy24 | = | 170-2401 = 
7 0 

50 ®fe®m®mmm e 4 a^niwi^ a 6 3 T»m 
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ZtlfctitfjmS K 6 2, 6 4fr£S/h<D(±S 
+j|g<5m i ntKZftfemmmdm i n^tttfJ-fSo 0 
5fC7jrf <k ftfe&m&dmi nte8 = 30t 

KZmmMd 2T*$>% 0 

[0 0 2 8] Htllldmi ntr^^dZ^mm 
3 2OCDjffigffi}itCy0 2, C y 4 2 frP>Hj+j£tl3S 

n\m^m 5t±, t^ilffldmi n-f^^d 2 
*1#J#-t3 2OCDj£}gIifSCy0 2, Cy4 2fr£tB+j 

$n§*^x-^^¥^LT, TOiiDa v^sai-r 10 

Dav = (240 + 21 0) /2 = 2 2 5 
[0 0 2 9] ^Ui$nfc¥^SDav = 2 2 5ti, ^1% 

at*, r am3 nciBS^nT^&w^x-^o^ft 

l%BlgCy2 2fCttJSt3*?'r-*£, mti£ft/c¥ 
i^fiD a v = 2 2 5 fcfiSTTS C i:tcj; DHS&£tl& 0 
[0 0 3 0] it«©fci&{cS«[Oit«ff!lfCOl/>T 

[0 0 3 1] (JtttWl) Jt«0>J lEOV^TWW 

t5o J±««l 1 KKiBSRC y 2 2fr6tftfj<£n*« 
^ x-^*«IjE1-57?ffit LT, feKO^gH^C y 2 

Cy22=Cy20 

[0 0 3 2] -rftt>-&, ±SB©a©«fc3fc:KI«iH*Cy 
2 2^P>tii^$n^1t : Fr-^cDfi^, Cy2 0<DffiT? 

?f-^OHl*0«^, MIBlSC y 2 2*^©fff 30 
-^©tB^tiCy 2 0^|SI-©1 7 Ofcl^SCfcfc:* 

[0033] umm 2 ) imm 2 a, ^psh^ c y 2 

KcDHJgC y 2 0fr6Hi;&£nS*?x-*©ffifcfcj» 
CQIl^C y 2 4^P>Hi^$n?>m?7 :: '-^(Dflti:©¥^ 
fS*JH^*t>4>"P&3 0 Cy22 = (Cy20 + Cy2 
4) /2= (1 7 0 + 2 4 0) /2 = 2 0 5 



*f3Cy 2 Ofc.fctfCy 2 4 O 20011*^5 ffi^jSn 

Cy 2 2*^©a*tUTIISif « 0 LfctfoT, 0 5 
fcjR*-*54«?r-*0Hi;fr©*fc, ^PISffl^Cy2 
2 fr6©*?r— *0HtfJti 2 0 5 t^o £ t\zt^ 0 

[0035] omm 3 ) itmi 3 « % xmmm c y 2 

PfiffllSCy 2 2<D®miCftmt%8'D<Dj&mmmC y 0 
0, Cy02, Cy04, Cy20, Cy 24, Cy4 
0, Cy4 2*5+.tfCy 4 4 fr5>tB+j£n?>W?T-£ 

Cy22=(Cy00+Cy02+Cy04+Cy20+Cy24+Cy40+Cy42+Cy44)/8 
=( 1 90+240+250+ 1 70+240+1 50+2 1 0+230) /8=2 1 0 
[0 0 3 6] t&t>*>. frmmmCy 2 2fc£Jg-T3 8 

¥^«^Pfia*Cy 2 2^5©ttJ*fcbTB»-r«o 

fcH&HSRCy 2 2^P><D«?r-^(DtB^(i2 1 0 

[0 0 3 7] (^«tHfe«fctfJt«M®i?tt) JisBO^fig 
M45 itfikPJtli Lfc£i££, 0 6 tcjjVf J: 5 

3>Lfc*S^J-XToanc^LTi/^ 0 £<DW 

mva±£(omffl&*vi&mD*5K.8b 1 1 (2 

5 6 KM) Of-^^fflV^fe©T*»i5:^„ 
[0 0 3 8] f¥ffi©7jj£fi, ^©fcfe*)-e*5o BS«© 
ft *©«Jrfctt£ LfcKKMJRfr P. tH+j $ n-5*f r- 

^<Dfi*±sonj6tw, jt«eai, \tm\2is^mm 

cDtB^fl^ og|fg*88tf § c £ 1 j: <o ffiJEcowm* L 

»^wsiB^T*s5o ^misp i^P6(t mmw 

-So 

[0 0 3 9] 
[Hi] 



SIS? 


mm 






JtttMl 




ttlM3-. 




en 




SSI 


ffl 


mm 


® 




1 


359 


358 


1 


266 


93 


344 


15 


358 


1 


2 


306 


303 


3 


310 


4 


382 


76 


277 


29 


3 


287 


2Y3 


14 


325 


38 


234 


53 


245 


42 


4 


210 


216 


6 


301 


91 


207 


3 


212 


2 


5 


236 


238 


2 


190 


46 


253 


17 


249 


13 


6 


347 


376 


29 


346 


1 

p 


384 


37 


371 


24 
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[0 0 4 0] glfre>fcfrS<fc?fC, iWJK.fcSffilE 

mmimm i , j±ts$i 2 *5 j; tftb$0y 3 ttt^L. 
tmm i © p 4 , w«otHT?sjKw*fe«t> o t 

5o 10 
[00 4 1] *3GK0!llc i?f^;W^5 l © 

[0042] wMfcfrt><Dmmytis>X2 ltctoc 

CD2 2^\*^^n5 0 CCD2 2t?tt*)t$nfc^ 

CDS^AGCft n if9BMf£tirz7t u Vim 

T°h%<DT\ A/D^2 3T'f->^/^tff-^ 20 

^JtLT^fiE^nSo •?• LT, 0fl*.tfJPEG (Joint 
Photographic Experts Group) I F F (Tagged Ima 
ge File Format) & if CD 7 T -f/l'MCfff-^CE 

ttsn, 777fa«y 3 z^as^nsBS^nSo 

[0 0 4 3] «tWLfc«t5K, ±ffiHSIS0!|{i:J:S 

wmmmxmc &%t, mmmmm- z 2 mmm-tr 
%&ji2ft&m?T-2<Dtiit)m ii m'btf£2 > mmM% 30 

mzcttfi-ezzo zvrctb, mmm%ffif$.?5>2'D 
[0044] ^lt> c(Dmmm*ffij$.t%2~D(Dwm 
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[0045] wi, imnmmximmmmmmt lx 
*) mm. & xiKm^T- $ < mmzmu % en 

[0 0 4 6] ±SBHJS0!l"Pt±tife7-r;l/3f*Wr 
SCC D^P>tB^$nSH{icD*^r-^co5aa^o^ 

StlSH^CDW^x-^cD^a, CCDWttOSitf*? 
cD®a> ^b-7s^-;l/CDl)^CD*^f f -^(D5!lS, $ 

fcti 2 hb#o«? r-^ojaa!* zic t>mmt % c <t 

[0ffi©IS#^^] 

[hi] *«w©-*fi6«ijKJ:sia«ftiawao^RSiB 

[0 2 ] *«WO-HSfi«!lfc: iSfi'^W p< 7*7tfr 
•7u-ytmX&2> 0 

im 3 ] *nw<D-mmmic j:§f->*^;w * ^cdms 
ius§^-r7p y t>mxh%>* 

[0 4 ] *mw-nffi$ OK: £ 5 r -7^;1/* ;>< 5 © C C 

[0 5] *3sno-AM0i£^«iBft«»DSrso^Ha 
■?mx&z> 0 

[06] *«w©-^sjnwtc«fcs«g#«ia^ji%8iwr 



1 




1 0 


MM* 


2 2 


CCD (»H*¥8) 


3 0 




6 0 


saaiiss 


6 1 




6 2 




6 3 




6 4 




6 5 




66 





(7) 



WP2 0 0 1-30 7 07 9 



[01] 



[02] 



22 



,1 



d1 



d2 



d3 



d4 



<i .X 

-'CyOO) 


i r 

^eoi: 


^CyO^ 


■YeQ3' 


y 


•Ye05 


MgVQ 

i V 


G11 i 




j G13 


Mgl4 


G15 




\ 

✓ > 
^ i 




V^23 

1 S 

! v 


^Cy2> 


!Ye25 


Mg30' 


G31 j 


Mg~32 

✓ V 


|G33 


"Mg34 

\ 

\ 


G35 


''Cy4(J 

' - 

V / 






!Ye43. 


V 

' — ~s 


Ve45 


Mg50 


G51 


Mg52 


G53 


Mg54 


G55 



20 / 10 

24 21/ 22 23 / 12 / 11 72 




[03] 
60 



61 



62 



42 41 



14] 



22 



63 / 64 65 66 

U//L 



Mg 


G 


Mg 


G 


Mg 


G 


Cy 


Ye 


Cy 


Ye 


Cy 


Ye 


Mg 


G 


Mg 


G 


Mg 


G 


Cy 


Ye 


Cy 


Ye 


Cy 


Ye 


Mg 


G 


Mg 


G 


Mg 


G 



[05] 



CyOO 
190 


Ye01 


Cy02 
240 


Ye03 


Cy04 
250 


Mg10 


G11 


Mg12 


G13 


Mg14 


Cy20 
170 


Ye21 




Ye23 


Cy24 
240 


Mg30 


G31 


Mg32 


G33 


Mg34 


Cy40 
150 


Ye41 


Cy42 
210 


Ye43 


Cy44 
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(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an image processor, an image 
processing method and a recording medium capable of highly accurately 
correcting electronic data outputted from a defective pixel. 

SOLUTION: Proximity pixels CyOO, Cy02, Cy04, Cy20, Cy24, Cy40, Cy42 and 
Cy44 provided around the defective pixel Cy22 are detected and pixel sets 
d1-d4 are prepared. Then, the pixel set for which the output difference of the 
electronic data outputted from the two pixels constituting the pixel sets d4-d4 
becomes minimum is extracted. Thus, the pixel set for which the change amount 
of the output of the electronic data is the smallest around the defective pixel 
Cy22 is extracted. The output value of the electronic data outputted from the two 
pixels constituting the pixel set is averaged and approximated to the electronic 
data outputted from the defective pixel Cy22. By replacing the average value 
with the electronic data outputted from the defective pixel, the electronic data 



outputted from the defective pixel Cy22 are highly accurately corrected. 
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CLAIMS 
[Claim(s)] 

[Claim 1] An image pick-up means by which two or more arrangement of the 
pixel which outputs the light which received light as electronic data is carried out, 
A contiguity pixel detection means to detect the contiguity pixel which 
approaches the defect pixel contained in said image sensor, is arranged, and 
receives the light of the same color as said defect pixel, A pixel group creation 
means to create a pixel group from two pixels arranged at physical relationship 
said whose defect pixel is pinched among said contiguity pixels detected by said 
contiguity pixel detection means, An output difference calculation means to 
compute the output difference of the electronic data outputted from two pixels 
which constitute said pixel group created with said pixel group creation means, A 
specific pixel group extract means to extract the specific pixel group from which 
the output difference computed with said output difference calculation means 
serves as min, An averaging means to compute the average of the electronic 
data outputted from two pixels which constitute said specific pixel group 



extracted with said specific pixel group extract means, The image processing 
system characterized by having a defect pixel data correction means to amend 
the electronic data outputted from said defect pixel to said average value 
computed with said average-value calculation means. 

[Claim 2] It is the image-processing approach which carries out amendment 
processing of the electronic data outputted from the defect pixel contained in an 
image pick-up means by which two or more arrangement of the pixel which 
outputs the light which received light as electronic data is carried out. The 
contiguity pixel detection stroke which detects the contiguity pixel which 
approaches said defect pixel, is arranged and receives the light of the same 
color as said defect pixel, The pixel group creation stroke which creates a pixel 
group from two contiguity pixels arranged at physical relationship said whose 
defect pixel is pinched among said contiguity pixels detected in said contiguity 
pixel detection stroke, The output difference calculation stroke which computes 
the output difference of the electronic data outputted from two pixels which 
constitute said pixel group created in said pixel group creation stroke, The 
specific pixel group extract stroke which extracts the specific pixel group from 
which the output difference computed in said output difference calculation stroke 
serves as min, The averaging stroke which computes the average of the 
electronic data outputted from two pixels which constitute said specific pixel 



group extracted in said specific pixel group extract stroke, The image-processing 
approach characterized by including the defect pixel data correction stroke 
which amends the electronic data outputted from said defect pixel to said 
average value computed in said average-value calculation stroke. 
[Claim 3] The image-processing approach according to claim 2 characterized by 
detecting eight contiguity pixels and creating four pixel groups from said eight 
contiguity pixels in said pixel group creation stroke. 

[Claim 4] An image pick-up means by which two or more arrangement of the 
pixel which outputs the light which received light as electronic data is carried out, 
To an image processing system equipped with the processing circuit which 
carries out amendment processing of said electronic data It is the record 
medium with which the program which performs processing for amending the 
electronic data outputted from the defect pixel contained in said image pick-up 
means was recorded and in which computer reading is possible. The contiguity 
pixel detection procedure of detecting the contiguity pixel which approaches said 
defect pixel, is arranged and receives the light of the same color as said defect 
pixel, The pixel group creation procedure which creates a pixel group from two 
contiguity pixels arranged at physical relationship said whose defect pixel is 
pinched among said contiguity pixels detected in said contiguity pixel detection 
procedure, The output difference calculation procedure which computes the 



output difference of the electronic data outputted from two pixels which 
constitute said pixel group created in said pixel group creation procedure, The 
specific pixel group extract procedure of extracting the specific pixel group from 
which said output difference serves as min, The averaging procedure which 
computes the average of the electronic data outputted from two pixels which 
constitute said specific pixel group, The record medium with which the program 
characterized by performing the electronic data replacement procedure which 
permutes the electronic data outputted from said defect pixel by said average 
value computed in_ said .average-value calculation procedure was recorded and 
in which computer reading is possible. 

[ClainfTS] TRe record medium whiclT~isncRaracterized by 'detecting eight contiguity 
pixels and creating four pixel groups from said eight contiguity pixels in said pixel 
group creation procedure and in which computer reading according to claim 4 is 
possible. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 



[Field of the Invention] This invention relates to the image processing system, 
the image-processing approach, and record medium which carry out 
amendment processing of the electronic data outputted from a defect pixel. 
[0002] 

[Description of the Prior Art] Solid-state image pick-up means, such as CCD 
(Charge Couplled Device), are widely used as for example, a digital still camera 
(digital still camera is hereafter called "digital camera".) image pick-up means. 
Generally CCD used for a digital camera has the pixel of 300,000 to 2 million. 
Especially, .in recent-years, in order to aim atJmagequality of a -digital camera, 
and improvement in resolution, the digital camera which carries CCD of a 3 
7rTillion-pi)^ra^^ 
[0003] 

[Problem(s) to be Solved by the Invention] However, the "defect pixel" which 
cannot read or output exact image information exists in solid state image 
sensors, such as CCD. A defect pixel outputs greatly different electronic data 
from the electronic data which should be outputted essentially. Therefore, when 
an image is generated from electronic data, the pixel defect_called a white 
blemish or **** is generated. 

[0004] A white blemish is generated when a defect pixel with a big output exists 
as compared with a surrounding pixel. On the other hand, **** is generated when 



a defect pixel with a small output exists as compared with a surrounding pixel. 
These white blemishes and **** have a possibility of becoming the big cause of 
image quality degradation with the surrounding color or surrounding brightness 
of a defect pixel which generates a white blemish or ****. 

[0005] Therefore, it is necessary to amend the electronic data outputted from a 
defect pixel based on the electronic data outputted from the pixel around a 
defect pixel. However, when the electronic data outputted from the pixel which 
adjoins like the edge part of an image changes a lot, the precision of amendment 
is low only by amending the electronic data outputted from a defect pixel based 
on the electronic data outputted from the pixel around a defect pixel, and there is 
a possilailfl^ and a surrounding pixel may fall. 

[0006] Then, the purpose of this invention is to offer the image processing 
system, the image-processing approach, and record medium which can carry 
out amendment processing of the electronic data outputted from a defect pixel 
with high precision. 
[0007] 

[Means for Solving the Problem] According to the image processing system 
according to claim 1 , the image-processing approach according to claim 2, or the 
record medium according to claim 4 of this invention, the contiguity pixel which 
approaches a defect pixel, is arranged and receives the light of the same color 



as a defect pixel is detected, and a pixel group is created from two pixels 
arranged at physical relationship whose defect pixel is pinched. The output 
difference of the electronic data outputted from two pixels which constitute the 
created pixel group is computed for every pixel group, and the pixel group from 
which the output difference serves as min is extracted. The average value of the 
electronic data outputted from two pixels which constitute the extracted pixel 
group is computed, and the electronic data outputted from a defect pixel by the 
average value is amended. 

[0008]_By_extracting„the^pixeLgroup from„whictL_the output .difference of the 
electronic data outputted from two pixels which constitute a pixel group serves 
^minTtlTe variation of "fhWbutput of electronic data can extract the smallest pixel 
group around a defect pixel. That is, the part the brightness of two pixels and 
defect pixels which constitute a pixel group, or whose change of the color 
difference is min can be extracted. In other words, it means that two pixels 
whose edges are not pinched can be chosen. Therefore, it can be considered 
that the electronic data outputted from two pixels which constitute a pixel group, 
and the electronic data outputted from a defect pixel are approximated. 
[0009] And the electronic data which should be outputted from a defect pixel can 
be made to resemble by averaging the electronic data outputted from two pixels 
which constitute this pixel group. Therefore, based on the electronic data 



outputted from a surrounding pixel in the electronic data outputted from a defect 
pixel, amendment processing can be carried out with high precision. 
[0010] According to the image : processing approach or the record medium 
according to claim 5 of this invention according to claim 3, four pixel groups are 
created from eight contiguity pixels. For example, in the case of area sensors, 
such as CCD, the pixel which approaches focusing on a defect pixel and 
receives the light of the same color is detected length, width, and aslant. Four 
pixel groups are created from this detected pixel. Therefore, since the pixel 
group to which_an output-difference serves as min_fromJhe_pixel group of four 
different directions is extracted, the direction dependency from a defect pixel can 
"Below, and~can rai^tl^~pr^isiorTof amendm^t^bcessin^r 
[0011] 

[Embodiment of the Invention] One example which shows the gestalt of 
operation of this invention is explained based on a drawing. Drawing 2 is the 
digital camera 1 which applied the image processing system by one example of 
this invention. 

[0012] As shown in drawing 2 , the digital camera 1 consists of a control section 
10, the image input means 20, the Records Department 30, a display 40, an 
interface 50, etc. A control section 10 is an electrical circuit for processing the 
electronic data outputted from the image input means 20. The control section 10 



has CPU (Central Processing Unit)11, ROM (Read Only Memory)12, and the 
processing circuit 60. The computer program performed in CPU11 and the 
processing circuit 60 of a control section 10 is recorded on ROM12. 
[0013] As shown in drawing 3 , the processing circuit 60 consists of the 
contiguity pixel detection means 61, the pixel group creation means 62, the 
output difference calculation means 63, a specific pixel group extract means 64, 
an average-value calculation means 65, and a defect pixel data correction 
means 66. Moreover, as shown in drawing 2 , the input means for receiving the 

input-from a user.is-connected-to.the_controLsection-tO.-Ihere-are-the shutter 

release 71 into which directions of activation of photography are inputted by the 
"user as "arinripuT means, two "of morenr^ut car&on buttons "72" into which 
actuation of the various functions of a digital camera 1 is inputted. 
[0014] The image input means 20 has the condenser lens 21, the analog circuit 
containing CCD22, AMP, and CDS as an image pick-up means, and A/D 
converter 23. A condenser lens 21 condenses the light from a photographic 
subject to CCD22. CCD22 has two or more pixels. Two or more pixels are 
arranged in the shape of a matrix to that CCD22 is horizontal and a 
perpendicular direction. 

[0015] As for the pixel, the color filter is arranged at the light-receiving side side, 
respectively. In the case of the color filter of the complementary color, it consists 



of Cy (Cyan), Mg (Magenta), Ye (Yellow), and G (Green) in many cases. The 
complementary filter of CCD22 is arranged as shown in drawing 4 . Moreover, it 
is applicable not only to CCD which has the color filter of the complementary - 
color like this example but image sensors other than CCD which has the color 
filter of the primary color which consists of R, G, and B, or Monochrome CCD 
and CCD. In addition, this example explains CCD22 which has a complementary 
color filter as shown in drawing 4 . 

[0016] The light by which incidence was carried out to each image sensor of 

CCD22. is_changed„and^outputted„to. an .electrical_signal.„Since Jhe .electrical 

signal outputted from CCD22 is an analog signal, it is changed into electronic 
dM^igitallA/ith^D"convefter23^ 

[0017] The Records Department 30 has RAM (Random Access Memory)31 and 
a flash memory 32. Even if it does not energize a flash memory 32, it is the 
rewritable record medium which can hold the contents of record, is built in the 
digital camera 1, or is attached in the digital camera 1 free [ attachment and 
detachment ]. RAM31 records temporarily the digital electronic data outputted 
from processing or A/D converter 23 by the control section 10. A flash memory 
32 accumulates and keeps the electronic data currently temporarily recorded on 
RAM31. 

[0018] The display 40 has the liquid crystal display (LCD) 41 and VRAM (Video 



RAM)42. LCD41 displays the image based on the digital electronic data 
outputted from the electronic data or A/D converter 23 currently recorded on the 
flash memory 32. In order to display on VRAM42 by LCD41, the indicative data 
created from electronic data is recorded. An interface 50 outputs the electronic 
data currently recorded on the flash memory 32 to devices, such as the exterior, 
for example, a personal computer etc. 

[0019] Next, the approach of an image processing is explained to a detail. Here, 
in CCD22 by which the pixel has been arranged as shown in drawing 1 as an 
example, the case wher_e_Gy22 is a .defect pixel is explained. "Cy" shows the 
color of the filter corresponding to the color of the light which the pixel receives, 
and the~pixel display of XyOO etc. in drawing 1 shows the expedient figure for 
expressing the coordinate whose "00" is the pixel. 

[0020] The electronic data outputted from CCD22 of the image input means 20 is 
once memorized by RAM 31 of the Records Department 30. Electronic data is 
memorized to the predetermined field of RAM31 corresponding to the address of 
each pixel of CCD22. 

[0021] As shown in drawing 1 , when there is a defect pixel, the contiguity pixel 
detection means 61 approaches a defect pixel Cy22, and is arranged, and the 
eight same color light-receiving pixels (the same color light-receiving pixel is 
hereafter called "contiguity pixel".) which receive the light of the same color as a 



defect pixel Cy22 are detected. In arrangement of a pixel as shown in drawing 1 , 
a contiguity pixel is eight, CyOO, Cy02, Cy04, Cy20, Cy24, Cy40, Cy42, and 
Cy44. A defect pixel Cy22 is detected in the defect pixel detection stroke carried 
out at for example, the time of factory shipments, or a predetermined stage, and, 
as for the detected defect pixel, the positional information is recorded on a flash 
memory 32. Therefore, the contiguity pixel detection means 61 detects eight 
contiguity pixels CyOO, Cy02, Cy04, Cy20, Cy24, Cy40, Cy42, and Cy44, as 
shown in the part enclosed with the ellipse of drawing 1 based on the positional 
information. ofJhe defect _pixeLCy22j currently, recorded on the flash memory 32. 
[0022] The pixel group creation means 62 creates a pixel group from the 
detected contiguity pixel. A pixel group is created about two contiguity pixels 
arranged at physical relationship whose defect pixel Cy22 is pinched. Namely, a 
pixel group is created focusing on a defect pixel Cy22, respectively in a 
lengthwise direction, a longitudinal direction, and the two directions of the 
diagonal line, as the broken line of drawing 1 shows. Therefore, four pixel groups 
d1 (CyOO and Cy44), d2 (Cy02 and Cy42), d3 (Cy04 and Cy40), and d4 (Cy20 
and Cy24) are created. 

[0023] The output difference calculation means 63 computes the output 
difference delta, respectively about the created pixel groups d1, d2, d3, and d4. 
two pixels (CyOO and Cy44) from which the output difference delta constitutes 



the pixel groups d1, d2, d3, and d4, respectively, and (Cy02 and Cy42) — and 
(Cy04 and Cy40) (Cy20 and Cy24) » from - it is computed based on the 
electronic data which is outputted and is memorized by RAM31. Here, electronic 
data is gradation which shows the magnitude of the electronic data outputted 
from a pixel. For example, when the electronic data outputted from a pixel is 8 
bits, it will be called 256 gradation from zero to 255. 

[0024] For example, the output difference is as follows when the electronic data 
outputted from the contiguity pixels CyOO, Cy02, Cy04, Cy20, Cy24, Cy40, Cy42, 

^and.-Cy44_shows. drawing-5. „ The magnitude of the_electronia_data outputted 
from each contiguity pixel is a figure indicated under the pixel display which 

Shows' each pixel in drawing's " 
[0025] By the following formulas The pixel group d1 Two pixels to constitute The 
output difference of the electronic data outputted from (CyOO and Cy44) delta 1 
and the pixel group d2 Two pixels to constitute The output difference of the 
electronic data outputted from (Cy02 and Cy42) The output difference of the 
electronic data outputted from two pixels (Cy20 and Cy24) which constitute delta 
3 and the pixel group d4 in the output difference of the electronic data outputted 
from two pixels (Cy04 and Cy40) which constitute delta 2 and the pixel group d3 
is set to delta 4. 

[0026] When shown in drawing 5 , the electronic data outputted from a defect 



pixel Cy22 is small, and serves as **** in an image from the electronic data 
outputted from the surrounding contiguity pixels CyOO, Cy02, Cy04, Cy20, Cy24, 
Cy40, Cy42, and Cy44. 
[0027] 

delta1=|Cy00-Cy44|=|190-230|=40delta2=|Cy02-Cy42|=|240-210|=30delta3=|Cy 
04-Cy40|=|250-150 | The =100delta4=|Cy20-Cy24|=|170-240|=70 specification 
pixel group extract means 64 extracts the specific pixel group dmin which serves 
as the minimum output difference deltamin from the output differences deltal, 

delta2,_delta3, and-delta4 computed-with the output-difference calculation means 

63. When shown in drawing 5 , the specific pixel group dmin is the pixel group d2 
used~ais cleTfa=~3~0! 

[0028] The electronic data outputted from two contiguity pixels Cy02 and Cy42 
which constitute the specific pixel group dmin, d2 [ i.e., ], is processed by the 
averaging means 65. The averaging means 65 computes the average Dav by 
averaging the electronic data outputted from two contiguity pixels Cy02 and 
Cy42 which constitute the specific pixel group dmin, d2 [ i.e., ]. 
Dav= (240+210) / 2= 225 [0029] Amendment processing of the average-value 
Dav=225 computed is carried out by the defect pixel data correction means 66. 
Amendment processing is carried out by permuting the electronic data 
corresponding to a defect pixel Cy22 by average Dav=225 computed among the 



electronic data currently recorded on RAM31. 

[0030] Next, two or more examples of a comparison are explained for a 
comparison. Two or more following examples of a comparison explain using the 
output value of the electronic data shown in arrangement and drawing 5 of the 
pixel shown in drawing 4 like the above-mentioned example. 
[0031] (Example 1 of a comparison) The example 1 of a comparison is explained 
first. The value of the electronic data outputted from the contiguity pixel Cy20 on 
the left is used for the example 1 of a comparison as an approach of amending 

_ the_electronic data outputted from a defect pixel. Cy22 _ 

Cy22=Cy20 [0032] That is, the value of the electronic data outputted from a 
defect pixel Cy22 like the above-mentioned formula is permuted with the value of 
Cy20. Therefore, in the case of the output of electronic data as shown in drawing 
5 , the output of the electronic data from a defect pixel Cy22 will be called 170 
[ same ] as Cy20. 

[0033] (Example 2 of a comparison) The average of the value of the electronic 
data outputted from the pixel Cy20 on the left and the value of the electronic data 
outputted from the pixel Cy24 on the right is used for the example 2 of a 
comparison as an approach of amending the electronic data outputted from a 
defect pixel Cy22. Cy22= (Cy20+Cy24)/2 = (170+240) / 2= 205 [0034] That is, 
the output value of the electronic data outputted from two pixels of Cy20 and 



Cy24 close to right and left of a defect pixel Cy22 is averaged, and the average 
is permuted as an output from a defect pixel Cy22. Therefore, in the case of the 
output of electronic data as shown in drawing 5 , the output of the electronic data 
from a defect pixel Cy22 will be called 205. 

[0035] (Example 3 of a comparison) The average of the electronic data outputted 
from eight contiguity pixels CyOO, Cy02, Cy04, Cy20, Cy24, Cy40, Cy42, and 
Cy44 close to the perimeter of a defect pixel Cy22 as an approach of amending 
the electronic data outputted from a defect pixel Cy22 is used for the example 3 

oTaxomparison. _ . _ . 

Cy22= (Cy00+Cy02+Cy04+Cy20+Cy24+Cy40+Cy42+Cy44)/8 
"(190+240+250+170+240+150+210+230) / 8= 210 [0036] That is, the output 
value of the electronic data outputted from 8 pixels close to a defect pixel Cy22 
is averaged, and the average is permuted as an output from a defect pixel Cy22. 
Therefore, in the case of the output of electronic data as shown in drawing 5 , the 
output of the electronic data from a defect pixel Cy22 will be called 210. 
[0037] (Evaluation of an example and the example of a comparison) The result 
which applied and carried out the simulation to the actual image which outputs 
electronic data as shows the approach explained in an above-mentioned 
example and the above-mentioned example of a comparison to drawing 6 is 
shown in the following table 1. In addition, in this evaluation, it is not a thing 



using 8 bits (256 gradation) data like an above-mentioned example and the 
example of a comparison. 

[0038] The approach of evaluation is_as follows. The value of the electronic data 
outputted from the defect pixel set as the location of the arbitration of an image is 
computed from an example, the example 1 of a comparison, the 
above-mentioned example 2 of a comparison, and the above-mentioned 
example 3 of a comparison. Amendment is evaluated by examining the error of 
the computed value and the output value from an actual defect pixel. Since P6 is 
set as arbitration from the defect pixel P1 used for the simulation for evaluation, 
an actual output value is known. As shown in drawing 6 , the part to which it 
adds^shadihg is a defect"pixel7The error has set P6 as the perimeter of the edge 



part considered to become large from the defect pixel P1. 

[0039] 
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[0040] As shown in Table 1 , as compared with the example 1 of a comparison of 
others [ amendment I by the example ], the example 2 of a comparison, and the 
example 3 of a comparison, the overall error is small. Depending on [ example ] 
the location of a defect pixel, the error of the example of a comparison may 
become small, case [ however, ] the value of the error shown in Table 1 is big — 
(for example, Pexample of comparison 4 reference of one) a color visual in an 
image - strange - it carried out comparatively, and has been recognized and a 

cleatxolor change has arisen in the place where especially a value with error is 

big. Therefore, it turns out that this example with an error small on the whole is 
effective"in amendmenfof aTdefect pixer 

[0041] Next, actuation of the digital camera 1 by this example is explained briefly. 
The electric power switch of the digital camera 1 which is not illustrated by the 
user is turned ON, and if a shutter release 71 is pushed in, photography will be 
performed as follows. 

[0042] The light from a photographic subject is condensed with a condenser lens 
21 to CCD22. In CCD22, the condensed light is changed and outputted to an 
electrical signal. Since the outputted electrical signal is an analog signal by 
which analog processing was carried out by CDS, AGC, etc., it is changed into 
electronic data digital with A/D converter 23. This electronic data is created as a 



suitable color picture, after image processings, such as a color tone, and 
amendment of exposure and amendment of the above pixels or interpolation, 
are carried out by the processing circuit 60. And it is compressed into the 
electronic data of file format, such as JPEG (Joint Photographic Experts Group) 
and TIFF (Tagged Image File Format), for example, and it is reproduced and is 
recorded on a flash memory 32. 

[0043] As mentioned above, as explained, according to the image-processing 
approach by the above-mentioned example, the pixel group from which the 
. output, difference -of-the_electronic data .outputted from__two_ pixels, which 
constitute a pixel group serves as min is extracted. By extracting the pixel group 
from which an output difference serves as min, the variation of the output of 
electronic data can extract the smallest pixel group around a defect pixel. That is, 
the part the brightness of two pixels and defect pixels which constitute a pixel 
group, or whose change of the color difference is min and which is approximated 
evenly can be extracted. Therefore, it can be considered that the electronic data 
outputted from two pixels which constitute a pixel group, and the electronic data 
outputted from a defect pixel are approximated. 

[0044] And the electronic data outputted from a defect pixel can be made to 
resemble by averaging the electronic data outputted from two pixels which 
constitute this pixel group. Therefore, based on the electronic data outputted 



from a surrounding pixel in the electronic data outputted from a defect pixel, 
amendment processing can be carried out with high precision. 
[0045] As mentioned above, although the above-mentioned example explained 
the example applied to the digital camera as an image processing system, it is 
also applicable to software, such as a driver of image readers, such as not only a 
digital camera but a scanner, and a copying machine, and the airline printer 
which prints the image based on electronic data. 

[0046] Moreover, the above-mentioned example explained processing of the 

. electroniC-data_ of-JheJmage. outputted jf rom .CCD-which_has. a .complementary 

filter. However, this invention is applicable to processing of the electronic data of 
the~image"o"utputted from CCD which has the filter of not only CCD that has a 
complementary filter but primary color, processing of image sensors other than 
CCD, processing of the electronic data of the image of gray scale, or processing 
of the electronic data of a binary image. 



DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing 1] It is the mimetic diagram showing the physical relationship of the 



defect pixel of the image-processing approach and contiguity pixel by one 
example of this invention. 

[Drawing 2] It is the block diagram showing the digital camera by one example of 
this invention. 

[Drawing 3] It is the block diagram showing the processing circuit of the digital 
camera by one example of this invention. 

[Drawing 4] It is the mimetic diagram showing CCD of the digital camera by one 
example of this invention. 

[Drawing 5] It is drawing-showing-the.magnitude_of the electronic data_outputted 

from the defect pixel and contiguity pixel of the image-processing approach by 
one~exarnple of thisTnventiori. 

[Drawing 6] In order to explain the image-processing approach by one example 

of this invention, it is drawing showing the magnitude of the electronic data 

outputted from a defect pixel and a contiguity pixel. 

[Description of Notations] 

1 Digital Camera 

10 Control Section 

22 CCD (Image Pick-up Means) 

30 Records Department 

60 Processing Circuit 



61 Contiguity Pixel Detection Means 

62 Pixel Group Creation Means 

63 Output Difference Calculation Means 

64 Specific Pixel Group Extract Means 

65 Averaging Means 

66 Defect Pixel Data Correction Means 



